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Method, System and Camera for Taking Composite Pictures 
Field of the Invention 

5 The present invention relates to a method, system and camera for taking a picture 
composed from two images. 

Background of the Invention 

It is well known to provide for images to be combined to form a final picture and the 
10 ability to do so has Become much more widespread in recent times with the advent of 
digital photography and image-editing programs running on home computers. Even so, the 
average user of a camera does not want to concern themselves with such technicalities. 

It is an object of the present invention to provide a simple way of taking pictures that 
1 5 combine images and, in particular, for taking such pictures where one image is current and 
the other historical (that is, not current). 

Summary of the Invention 

According to one aspect of the present invention, there is provided a method of providing 
20 for the taking of a combined picture, the method comprising: 

(a) at a site of interest, using a data-storage element to store data comprising an historical 
image or a reference to it; 

(b) using a camera both (i) to read the stored data at the site whereby to directly, or by 
following a said reference, download said historical image as first digital image data, 

25 and (ii) to optically capture a current image at the site to form second image data; 

(c) in the camera, combining said first and second image data to form a combined picture; 
and 

(d) storing the picture in a picture memory of the camera. 

30 According to another aspect of the present invention, there is provided a system that 
provides for the taking of a combined picture, the system comprising: 
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- a data-storage element provided at a site of interest for storing data comprising 
historical image or a reference to it; and 

- a camera comprising: 

- a first subsystem arranged to read the data stored in said data-storage element 
5 whereby to directly, or by following a said reference, download to the camera said 

historical image as first image data; 

- a second subsystem for converting an optically-input second image into second 
digital image data; 

- an image-combining arrangement, including a display, for combining the images 
10 represented by the first and second image data to form a combined picture; and 

- a picture storage arrangement responsive to user input to store said combined 
picture. 

The present invention also provides a camera adapted for use in implementing the method 
1 5 of the invention. More particularly, according to a further aspect of the present invention, 
there is provided a camera comprising: 

- a first subsystem for electronically downloading, from externally of the camera, first 
digital image data representing a first image; the first subsystem being arranged to read 
said first image data or a reference to it from a data-storage element installed in the 

20 local environment; 

- a second subsystem for converting an optically-input second image into second digital 
image data; 

- an image-combining arrangement, including a display, for combining the images 
represented by the first and second image data to form a combined picture; and 

25 - a picture storage arrangement responsive to user input to store said combined picture; 
the first subsystem being arranged to automatically pass the first image data to the image- 
combining arrangement at the time that data is downloaded. 

According to a yet further aspect of the invention, there is provided a camera comprising: 
30 - a first subsystem for electronically downloading, from externally of the camera, first 
digital image data representing a first image, the first subsystem comprising a data 
interface that requires positioning at, or in juxtaposition to, an external data-storage 
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element in order to read therefrom said first image data or a reference to it, whereby 
selection of a desired said first image is effected by appropriately physical positioning 
the camera to enable the data interface to read the data-storage element corresponding 
to the desired first image; 

- a second subsystem for converting an optically-input image into second digital image 
data; 

- an image-combining arrangement, including a display, for combining the images 
represented by the first and second image data to form a combined picture; and 

- a picture storage arrangement responsive to user input to store said combined picture. 



Brief Description of the Drawings 

Embodiments of the invention will now be described, by way of non-limiting example, 
with reference to the accompanying diagrammatic drawings, in which: 
. Figure 1 is a diagram showing a camera being used to take a photograph of a 
15 memorial with the inclusion of an historical image of a person 

commemorated by the memorial; and 
• Figure 2 is a functional block diagram of the Figure 1 camera. 



20 Best Mode of Carrying Out the Invention 

Figure 1 depicts a hand-held camera 10 embodying the present invention. The camera 10 is 
being used to take a photograph of a war memorial 20 on which are listed the names 21 of 
service men and woman commemorated by the memorial. 

25 The camera 1 0 comprises an optical image-capture system 1 1 including a lens arrangement 
1 1 A (see Figure 2) and a photoelectrical sensor 1 IB that maybe of any suitable form such 
as a CCD array. The image captured by the sensor 1 IB is temporarily stored in a working 
memory 15 and is from there displayed to a user of the camera on viewfinder display 13. 
The memory 15 is preferably separate from the sensor array 1 IB but is updated regularly 

30 from the latter (for example 24 times a second). 
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In addition to the optical image-capture system 11, the camera 10 also comprises an 
interface 12 for receiving digital data signals representing a previously-stored, historical 
image - in this case an image 23 of any selected one of the commemorated persons. More 
particularly, in the present example, alongside the name 2 1 of each commemorated person 
5 on the memorial 20, is embedded an inductively-powered memory module 22 that stores, 
as digital data, an image of the person concerned. In order to download the image data held 
in a module 22, the camera 10 is brought up close to the memory module 22 such that the 
camera's interface 12 is juxtaposed the module resulting in the latter being inductively 
powered up. Upon this happening, the memory module is arranged to transmit its stored 
1 0 data by very short-range wireless signals to a wireless pickup incorporated in the interface 
12. Memory modules of this form are known in the art and module 22 and interface 12 
will therefore not be described in further detail herein. 

The image data downloaded through interface 12 is held in a temporary memory 30 of the 
1 5 camera from where it is copied to the working memory 1 5 and, as a result, is displayed on 
viewfmder display 13. Transfer of the image data to the memory 15 is preferably, though 
not necessarily, done automatically upon downloading of the image data on the assumption 
that the image concerned is for immediate use. 

20 It will be appreciated that in the present embodiment the interface 12 needs to be placed 
right up close to the selected memory module 22 in order to download data from the 
module to the camera 10. This has two consequences, the first being that selection of the 
memory module 22 to be activated is simply a matter of bringing the interface 12 right up 
close to the module it is desired to read. The second consequence is that the user cannot 

25 pick up image data from a memory module 12 whilst positioned to take a picture of the 
memorial 10. 

The optically-input image 25 is used to form a background behind the downloaded person- 
image 23 whereby the user sees in the viewfmder display 13a combined image of the form 
30 illustrated at 26 in Figure 1 . To this end, each time the image captured by the sensor 1 IB is 
transferred to memory 15, it is not written into memory locations of the memory 15 that 
hold downloaded-image data from memory 30; this can be achieved by using one bit of the 
multi-bit data held in each memory location as a flag bit to indicate whether the data 
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currently stored in the location is downloaded data (for example, the bit is set if the stored 
data is downloaded data). Before data is written into a memory location from the sensor 
1 IB, the flag bit of that location is checked and the location is only written to if the flag bit 
indicates that the location does not contain downloaded image data. 

It can be seen that the working memory 15 forms the basis of an image-combining 
arrangement for combining the optically captured image and the downloaded imaged. 
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The user can record the combined image by pressing a "shutter" control 32 that causes a 
control block 33 to store a digital copy of the image seen in viewfinder display 13 in a 
long-term picture memory 34 of the camera. 
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The contents of the optically-input image 25 forming the background in the combined 
image are dependent on what scene the camera is pointing at and the optical settings of the 
lens arrangement 11A . This image is thus under the control of the user; because the 
memory 15 is updated multiple times a second from the sensor 1 IB, any change in what 
5 the user is pointing the camera at is immediately reflected in the contents of the memory 1 5 
and the image seen on viewfinder display 13. 

The user can also incrementally (that is, in very small steps such as pixel sized steps) 
control the size and placement in the combined image 26 of the downloaded person-image 

10 23 by means of controls 3 1 that cause a transfer block 36 to set the scaling and position of 
the image 23 as it is copied from memory 30 to memory 1 5 . Whenever the position or size 
of the image 23 is changed using the controls 31, before writing the image anew into the 
memory 1 5 the block 36 first erases the contents of memory 15; thereafter, block 36 writes 
the image 23 in its new position/size into memory 15 with the flag bit of the locations 

15 written to being set to indicate that those locations are not to be overwritten by the 
optically-input image data. It will be appreciated that the image 23 is taken not to be 
present where there is no significant visually-discernible feature indicated by the image 
data (thus, for example, a blank or white or black background will be ignored). 
The user can thus control both the optically-input and electronically-downloaded image in 

20 forming the desired combined picture, this control being effected with the minimum of 
trouble and without the use of complex editing equipment. 

After a combined picture has been recorded by operation of control 32, the temporary 
memory 30 and the working memory 15 can be cleared - or, indeed, left unchanged 
25 pending a new image being downloaded via interface 12. 

It will be appreciated that many variants are possible to the above described embodiments 
30 of the invention. Thus, the optically-input image could be latched into an intermediate 
memory (see latch memory 40 shown dashed in Figure 2) at, for example, the same time as 
a first combined picture is recorded using the control 32, the memory 15 then being 
refreshed regularly from memory 40 in the manner already described for refreshes from the 
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sensor 1 IB. Such an arrangement permits the same background image to be used in several 
combined pictures each of which may include a different downloaded image. 

The above-described arrangement for combining the optically-input image and the 
5 downloaded image is unsophisticated and relies on the downloaded image being of a form 
suitable to overlay a background image. More sophisticated image-combining 
arrangements, known per se, can be used to merge the optically-input and downloaded 
images. 

10 Furthermore, the downloaded image need not necessarily form a foreground image and 
could, instead, be used as a background image for an optically-input image, the latter now 
serving as a foreground image. 

With regard to how the electronically-downloaded image is received by the camera 10, it 
will be appreciated that the described memory module arrangement is but one example of 
many possible ways of downloading a relevant image. For example, images can be 
downloaded from contact-based memory cards used as local image stores. Alternatively, a 
short-range radio system, such as a Bluetooth system, can be used to transfer image data to 
the camera. In this latter case, where the local density of images for download is low, then 
a single image can be associated with each short-range wireless system. However, where a 
short-range wireless system is to be used as the download arrangement for more than one 
image, then it will be necessary to provide a way of indicating the desired image to the 
download wireless transmitter; this can be done, for example, by selection buttons on the 
camera to provide input (via the short-range wireless system) to the image transmitter, or 
by the provision of buttons directly connected to the image transmitter system itself. Of 
course, it is also possible to provide for the camera to receive multiple downloaded images, 
image selection then being done at the camera by discarding unwanted images. 

Other arrangements for downloading images include providing a central or distributed 
30 image store from which an image can be downloaded via a wireless LAN or cellular 
mobile link, the desired image being indicated to the store using a locally-captured image 
reference or locality indicator (in this latter respect, the current location of the camera as 
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indicated by any suitable system - such as a GPS system, a PLMN-based system, a 
location-beacon system etc - can be used to retrieve images relevant to the camera's 
current location). 

5 Generally, the camera 10 is intended to enable a user to record a picture that is a 
combination of a current image captured through the optical system of the camera, and an 
historical (that is, a stored and not current) electronically-downloaded image that is related 
in some way to the optically-input image. The relationship may be person to place as in the 
Figure 1 example or some other relationship. Another example combination is where the 
1 0 user visits a battlefield and a relevant downloaded battle map is combined with the current 
view of the battlefield; a more general example is that of the downloaded image showing 
an earlier view of the optically-input image (for example, an old image of a church is 
combined in side-by-side relation with a current optically-input view of the church). 

15 In fact, the downloaded image need not be an historical image but could be a current image 
taken from an infrastructure camera - for example, on visiting the Kennedy Space Center, 
a user could be enabled to download a current close-up image of a space shuttle being 
prepared for launch, this image being combined with the optically-input image of a person, 
(the person image being used as a foreground image and the space-shuttle image as 

20 background). 

Whilst in the preferred embodiments the capturing of the optically-input and electronically 
downloaded images and the forming and recording of a combined picture are all effected 
substantially at the same time with it being necessary to finish one combined picture before 

25 another is initiated, it is also possible to store, for later combination, the optically-input 
image and the electronically-downloaded image. In this case, the stored images are marked 
or stored in such a way to indicate their association whereby to facilitate subsequent 
retrieval and combination preferably in the camera, though possibly off camera (for 
example in a PC equipped with suitable editing software). Provision is preferably made for 

30 storing multiple sets of associated first and second images. 
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In another variant, the electronically downloaded data rather than being image data, or only 
image data, comprises audio data to be associated with the optically-input image. Thus a 
commentary about a place being visited can be recorded along with the user's own picture 
of the place. 

Although the above-described embodiments concern still images, it will be appreciated the 
same approach can be applied for combining, in camera, optically-input and electronically 
downloaded moving images. 



